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20 April 1977 


STAT MEMORANDUM. FOR: 
Administrative Officer, DCI 


SUBJECT : Time Spent by National Intelligence Staff on 
Program Evaluation 


1. The Staff spent the following man-hours on program evaluation 
in the last calendar year: 


* 


GS-18 recs) 
GS-15 1,642 
GS-09 980 


2. These man-hours were spent primarily on the following program 
evaluation exercises: 


a. FOCUS Studies: The NIOs convene interagency 


b. KIQs and KIQ Strategy Reports. Before any 
of these management guidance documents can be written, 


an evaluation of the current state of intelligence 
collection and analysis is required. 


c. Annual Work Programs. Particularly in the 
military estimative field, an evaluation is made upon 
the completion of major estimates to determine where 
the major gaps in our information and analysis exist 
and which analytical work programs should be launched 
so that the next estimate can provide better answers 


to the questions on policymakers’ minds. 


Executive Officer, 
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1 - NIO General File 
(W)- EO/NI Chrono File 


1 - D/DCI/NI 
1 - AD/DCI/NI 
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13 April 1977 


MEMORANDUM FOR: Deputy Director for Administration 
Deputy Director for Intelligence 
Deputy Director for Operations 
Deputy Director for Science §& Technology 
Executive Secretary 


THROUGH : ComptroliethS 1.4 APR WI T 


SUBJECT ~ : Resources for Program Evaluation in Fiscal Year 1977 
-- OMB Bulletin 77-8 


1. A report showing and comnenting on the CIA resources devoted 
to Program Evaluation is due in the Office of Management and Budget on 
25 April. It is in our interest that the CIA submission show as 
thoroughly and carefully as possible Agency efforts to systematically 
analyze its programs to ascertain the extent that they "have achieved or 
are achieving their objectives, or are producing other significant 
eftects:i.4"" 


2. A copy of the actual OMB Bulletin is attached; it requires 
some interpretation. Basically,-the data desired is that showing the 
extent that CIA attempts to determine "what has actually occurred as the 
result of past program actions," plus our efforts to develop evaluation 
methodologics and ensure that these are incorporated into existing and 
future programs. The efforts identified should be intended to assist 
management. 

3. For the purposes of this OMB tasking, program evaluation 
does not include: 


~- evaluation activities which are an intrinsic part of pro- 
gram operations or management; 


-- analyses of the relative cost/benefit of alternative 
approaches to programs that do not yet exist; 


~- the development and operation of management information 
systems ; 


-- the collection of routine data or the preparation of general 
statistics or basic research. 


> 


CONFIDENTIAL 
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5. The attachment to the OMB Bulletin shows the prescribed format 
for your input. Please give us a name of a contact person; we will not 
pass that name to OMB, We propose to provide OMB with data for each of 
the four Directorates and for the Office of the Director. One staff-year 
should be counted: for each full-time person who devotes more than fifty 
percent of his/her time to program evaluation activities or to monitoring 
such activities by contractors; part-time employees or employees working 
on evaluations less than fifty percent of their time are not to be 
included. A brief narrative description of program evaluation activities 
and of their expected impact is to be included (two or three paragraphs 
per Directorate). Significant increases or decreases in funding levels 
for evaluation activities from FY 1977 to FY 1978 are to be noted and 
major "policy or strategy changes" mentioned. 
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'6. <A two-three page Agency summary narrative will be prepared by 
this office and we welcome your suggestions. The data you provide 
should include activities of your components in support of interagency 
evaluation efforts (e.g., by the IC Staff) or of evaluation activities 
of other agencies. The Agency overview will note that CIA regularly 
participates in evaluations of Programs under the control of other 
Departments and Agencies. 


Sola 


meets 


7, Your data and narrative are needed by no later than COB 
21 April. We apologize for the tight deadline, but the OMB tasking only 


arrived in the Comptroller's Office on 12 April, and the OMB deadline is 
onday, 28 Apr fa ats) 2X 
coordinating this cFfort and he remains ready to talk further with yodbX1 


people regarding the nature and extent of the task, 


vaglige kai SLA atti a ast 


‘ 
H 
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! 
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Assistant Comptroller 
Requirements §& Evaluation 


| Attachment: 
As Stated 
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BULLETIN NO. 77-8 | ~ Ff april 4, 1977 


TO THE HEADS OF EXECUTIVE DEPARTMENTS. AND ESTABLISHMENTS 


SUBJECT: Resources for Program Evaluation in Fiscal Year 
1977 . ; 


1. Purpose. This Bulletin provides instructions for the 
submission. of information concerning the resources for 
program evaluation provided for in fiscal year 1977. 


2. Background. The Office of Management and Budget has 
determined the need to collect and analyze information on 
the level of Federal expenditures and staffing devoted to 
program evaluation activities. The information requested by 
this Bulletin is vital to an understanding of the magnitude 
of evaluation resources and the ways in which- these 
resources contribute to the achievement of national goals, 
agency missions, and program objectives. Moreover, 
increasing concern about the adequacy of data on program 
performance makes it necessary to assure that accurate 
information can he provided to the Congress and the public 
on the actual level of program evaluation expenditures. 


3. Coverage. These instructions apply to each executive 
department and independent agency with more than 800 
authorized full-time permanent employees. 


4. Definition. For purposes of this Bulletin, program 
evaluation means the formal assessment, through objective 
measurements and systematic analyses, of the manner = and 
extent to which Federal programs (or their components) have 
achieved or are achieving their objectives, or are producing 
ether Significant effects of either a desirable or 
undesirable character, in order to assist future policy and 
management decisions. 


a. The following will be considered as Federal program 
evaluation activities for the purpose of this Bulletin: 
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"Approved For Rel@age 2004/08/13 : SIArRBRS1 MAQGIGROIH200080018-0.. analyses for 


the purpose of determining the effectiveness, efficiency; ox 
impact of a national or regional program, 


mgs (2) Systematic assessment of demonstration programs 
Or projects which are expected to have major implication for 
programs of national or regional scope; except that 


evaluation activities which are an intrinsic part of the 
program operations or management should not bea reported. 


(3) Formal studies, Surveys, and data analyses .for 
the purpose of assessing program management processes, 
procedures, intervention technigues, workload distribution, 
or productivity. 


(4) Assessment and development of _program designs 
to assure that programs, once operational, can be 
Successfully evaluated, 


(5) Design, development, and field testing of new 
program evaluation methodologies. 


(6) Synthesis and further analysis of results 
obtained by several previous program evaluation efforts. 


(7) Collection of initial dat 
evaluation design and provide a basel 
evaluations. 


a to help in 
ine for subsequent 


b. fhe following will not be considered as program 
evaluation activities for the purposes of this Bulletin. 


(1) Design,: develovumen:, and operation of general 
data systems or management information systems, 


(2) Continuing collection of routine data and 
general purpose statistics. 

(3) Analysis of existing or proposed policies where 
no programs yet exist (even theugh authorized) for purposes 
of appraising the likely costs and effects of feasible 
alternatives. Although such analyses are often called 
"evaluations," they are prospective in character; whereas 
program evaluation is retrosvective, aimed at determining 
wnat has actually occurred as the result of past program 
actions, 


Q 
S 


(4) Basic research and studies intended to increase 
Or foster general knowledge cevelopment, but which are not 
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Managemen’ decisions. 
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Routine, day-to-day monitoring of program 
operations which is an PeCPaAns Le part of program 
administration. 


“30 ec. It iS recognized that the present extensive 
Variation among Federal agencies and programs will require 
case-by-case judgments to determine the applicability of the 
above ctiteria to agency "evaluation" activities. 


9. Reporting Requirements. Departments and agencies shovld 

Submit a report in accordance with the attached instructions 
and exhibit to OMB, attention: Evaluation and Program 
Implementation Division by April 25, 1977. This is a one- 


time report. 


6. Rescission. This Bulletin is rescinded Following 
receipt of the April 25, 1977 report. 


7. Inquiries. Inquiries and requests for assistance should 
be directed to the Evaluation and Program Implementation 
Division, Otfice of Management and Budget. (395-4726 or 


395-7642, ) 
AL pee 


Bert Lance 
DLIrecter 


Attachment 
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An Original and one copy of the report on program evaluation 
resources will be prepared on letter size Sheets (8x10-1/2) 
and. submitted in the format of the attached exhibit, as 
prescribed below. f° 


Date ~ Enter the date of preparation 

Contact - Enter the name and telephone number of an 
individual who can respond to questions relative to 
the information provided, : 


Part I. RESOURCES SCHEDULE: 


Department/Agency/Bureau ~ Enter the reporting department or 
independent agency. In the case of cabinet departments, 
enter each bureau or comparable organizational unit for 
which separate evaluation resources (funds and personnel) 
can be identified, a consolidated dine entry for any other 
Organizational units (if applicable), and a line entry for 
the total department or agency. At least one space should 
be left between each line ENntEY.. 


Staff years - Enter the estimated Staff-years for full-time 
permanent personnel who devote more than Fifty percent of 
their time to the program evaluation activities outlined in 
paragraph 4a of this Bulletin. Pnis includes full-time 
government personnel engaged in monitoring or directing such 
activities by contractors or grantees, 


alaries - Enter the estimated obligations for personnel 
ompensation related to the Staffi-year entry. 
| 


Personnel Benefits ~ Enter the estimated obligations for 
personnel benefits associated with the Salary figure. 
Contracts/Grants - Enter the estimated Obligations to be 
incurred for evaluation contracts Or grants, or, in the case 
of multi~purpose agreements, tne obligations for those: 
Dortions of the contracts or grants -that are directly 
velated to the program evaluation activities deseribed in 
paragraph 4a of this Bulletin. 


s 
3s 


iw) 


Other Expenses -— Enter the total obligations estimated for 
otner administrative exoenses directly related to the 
pectormance, commissioning, or oversight of the activities 
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. a ener —, a . : 
described" in paragraph 4a of this Bulletin. "Othe 
expenses" would include obligations for travel anc 


transportation of persons, transportation of things, rent, 
communications and utilities, printing and reproduction, 
: other services (such as ADP services), supplies anc 
ee materials, and equipment. Significant obligations for any 
of these "other expenses" should be briefly identified in 
the narrative. 


ae en ities 


fotal -~ Enter the total estimated FY 1977 obligations for 
Salaries, personnel benefits, contracts/grants, and other 
expenses. Note: All obligations are to be entered in 
thousands of dollars. 


Part If. NARRATIVE STATEMENT 


ae A brief explanatory statement should Gescribe in general 
i terms the program evaluation activities being undertaken and 
: the objectives toward which they are directed. It should 
b highlight significant increases or decreases in funding 
: levels. from the current fiscal year to FY 1978 and major 
ae policy or strategy changes expected to occur. Emphasis 


_snould «+ be placed on the expected use of evaluation 
information in the agency resource allocation and other 
perce decision, processes, In most instances, the narrative for 
7 individual bureaus should be restricted to two or three 
paragraphs and the departmental or agency summary should rot 
exceed two pages. 


Ue 
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EXHIBIT ae 
Bulletin No. 77<§ 


REPORT ON FY 1¥77 PROGRAM EVALUATION RESOURCES 
{Dollars in Thousands) 


Date: Be Pee tape eo oS 
Contact: fines ee 
Part I. RESOURCE SCHEDULE 
Personnel Contracts Other 
Staff Years Salaries Benefits Grants Expenses TOTA! 
Department/Agency/Bureau (FTP) __ {§) ___($) ($) ($) ($) 


Department of Government 

{Report breakdown of major 

bureau or other organiza- 

tional unit for cabinet 2 ( 
departments only) 


PART II. NARRATIVE STATEMENT - 
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19 April 1977 


MEMORANDUM FOR: NIO/AF 
N10/ EAP 
NIO/CH 
NIO/USSR 
NIO/WE 
Act NIO/LA 
NIO/NESA 


Please find attached priority lists which show in the 2. and 3. series 
(economic and military) where your suggested priorities for the DCID 1/2 
matrix disagree with those suggested by_others. The EIC and the military 


feel strongly about their suggestions; ear ERE 
involved in the economic priorities, which represented also the combined 


views of State, Treasury, and OER. If you wish to insist on your numbers, 
please let me know by COB, Tuesday, 19 April. The DCID 1/2 Ad Hoc Working 
Group will be meeting on Wednesday afternoon and Thursday morning to 
resolve the differences. [____———sidjand I will have a go at resolving any 
strongly held differences in economic priorities before tomorrow's meeting. 


Executive Officer, DCI/NI 


Attachment 
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Distribution: 
1 - Each NIO listed 
] - A/EO/DCI/NI 
1 - EO/DCI/NI 

7 - E0/DCI/NI Chrono 
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